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Attorney Docket No.: 10559/067002/P7554C 
METHOD AND APPARATUS FOR REAL TIME MONITORING 



OF USER PRESENCE TO PROLONG 
A PORTABLE COMPUTER BATTERY OPERATION TIME 



CROSS-REFERENCE TO RELATED APPLICATIONS 

5 This application claims benefit of U.S. Patent 

Application Serial No. 09/472,592, filed December 27, 1999. 

Background 

Portable computers often include structure for 
reducing their power consumption in order to increase the 

10 length of time they can run based on battery power, their 
so-called run time. Power consumption in such a portable 
computer can be reduced by terminating the supply of power 
to various devices in the portable computer. This can 
include turning off the display, stopping the hard drive, 

15 and other such features. Current systems of this type have 
used a time- out period in a register on the computer, e.g. 
a register in the basic input output system ("BIOS") . Each 
time the user takes an action on the keyboard or mouse, the 
BIOS counter is reset. After a user-selectable, 

20 predetermined period of inactivity, the power down mode is 
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entered. The time before auto power down usually ranges 
between 3 0 seconds and 3 0 minutes. 

Users often find it annoying if the screen blanks 
while they are taking an action such as reading the 
5 contents of the screen. Users hence often choose longer 
time outs to avoid this situation. However, this increases 
power consumption, and hence significantly decreases the 
battery operation time. 

The present application teaches a system which 
10 recognizes that the user's passive activity, like reading, 
should be taken into account when determining the time-out 
for such a system. According to the present invention, 
user activity is monitored in real time by a detection 
device, e.g., a camera, which monitors for the presence of 
15 a user in real time. The user's presence causes the 

computer to remain in the "on" or fully powered state. 
When the user is not present, the computer reverts to its 
low power state. 

Summary 

20 According to an aspect of the invention, a computer 

monitors the presence of a user, enters a power increase 
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State when the user is present, and a power decrease state 
when the user is not present. 

A power control device for a computer has a power 
control module which reduces power consumption of the 
5 computer in a specified mode; and a user detection system, 
which detects the presence of a user, and operates the 
power control module based on the presence of the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

These and other aspects will now be described in 
10 detail with respect to the accompanying drawings, wherein: 

Figure 1 shows a laptop computer with face tracking 
software that monitors for the presence of a user's face; 

Figure 2 shows a flowchart of operation of a first 
operation mode; and 
15 Figure 3 shows a flowchart of operation of a second 

operation mode. 



Detailed Description 

Figure 1 shows an embodiment of a portable computer 
20 100 using the techniques of the present invention. The 

portable computer 100 includes a user interface 102 which 
can include a keyboard and mouse, a processor 104 and 
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memory 106. A display 110 is driven by the processor. The 
computer also includes a power supply 115 which produces a 
power output to the various components. At least one of 
the display 110, the processor 104, and the hard drive 112 
5 is power controlled by a power management module 118, 
according to results of the system's power control 
flowchart. The power control can be done according to any 
well-known technique of power reduction during sleep state. 
For example, the computer can be power controlled according 

10 to the Advanced Configuration and Power Interface ("ACPI") 
specification, version 1.0, January 6, 1997. 

Other electrical functions may be necessary for the 
computer to operate properly. All of the parts of the 
computer are integrated into a housing 12 0. 

15 A camera 13 0 is either integrated into the housing or 

attached thereto. The camera 130 can be a small camera, 
with 640 X 480 or comparable resolution. The camera 
acquires an image from the direction where the user is 
expected, i.e., above the keyboard. The output of the 

20 camera is connected to the processor 104, either directly 
or through an imaging interface chip. 

The operation according to a first mode is shown in 
the flowchart of Figure 2 . 
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A Step 2 00, the camera 13 0 captures an image. This is 
done periodically under control of the clock 205. For 
example, the image could be captured every half second. 

At step 210, the processor runs a routine based on the 
5 image to analyze the contents of the image . The color and 
features of the image are determined. This can use any 
available image processing technique to determine the 
presence of a face. For example, one way of doing this is 
by correlating a feature, which is common to a face, across 
10 the entire image. 

The system can store a number of such features in a 
memory. This can include a number of different features 
which represent the shape of common eyes, nose, mouth, ears 
etc. Each can be correlated across the image to determine 
15 if anything that looks like an eye or nose or mouth or ear 
is within the field of the image. 

Another option is to investigate the image, to 
determine an area of the right color to represent average 
skin tone of a user. 
20 Step 220 carries out a decision based on whether the 

user's face is present. If the user's face is present, 
then the system ends power- reduced mode, and turns on the 
display at 230. If the user's face is not present, then the 
system turns off the display at 240. 
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Since the system operates in real time, the display 
can be switched off as soon as the user leaves. This can 
provide significant power saving. Even if the user sits in 
front the screen reading for ten minutes without checking a 
key, the screen will never be turned off. This also 
increases consumer satisfaction, since the screen will not 
blank while the user is watching it. 

The flowchart in Figure 2 carries out the following 
pseudocode . 

While (true) 

{if (user is detected) 

{display^state = on} 

ELSE 

{display_state=off} 

} 

The inventor recognized, however, that monitoring the 
camera and vision software can itself lead to increased 
power consumption. A lower power camera, such as one using 
active pixel sensors, is preferably used to minimize power 
consumption. 

The operation of the second embodiment can also reduce 
the power consumption. Accordingly, a second embodiment is 
shown in Figure 3 . According to the second embodiment , the 
camera operation is only carried out after user inactivity 
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for some user selectable time, e.g., one minute. After 
inactivity for that time, one minute, at step 300, the 
camera 130 captures an image at step 305. If the face is 
detected to be present at step 310, then a ten second timer 
5 is initiated at step 315, and the image is again captured. 
At any time during this flowchart, however, any activity 
causes a return, thus stopping the capture of images until 
another one minute of inactivity. 

If the face is not present at step 310, then the power 
10 is reduced at step 330. 

After entering the power reduced state, any user 
activity causes the power reduced mode to end and the user 
continues his operation. 

This is shown in the following psuedocode. 
15 While (true) 

Wait for user inactivity /* if the user is active, then the 

SYSTEM IS in use */ 

Activate camera and vision software 
Start_time=current_time ( ) 
20 While (cuRRENT_TiME 0 - start_time < timeout AND 

user_inactivity) 

{if (user is detected) 

{display_state=on} 

ELSE 
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{ DISPLAY_STATE=OFF } 

} 

} 

DEACTIVATE CAMERA AND VISION SOFTWARE 

IF (user_inactivity) 

{ DISPIiAy__STATE=OFF 
WAIT FOR USER ACTIVITY 

. } 

display_state=on 
other embodiments are contemplated . 
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